Extrapolation errors in Liu et al.’s CAM integrative review of health care professionals in New Zealand

This letter is to highlight errors made by Liu et al. in their 2020 paper in BMC Complementary Medicine and Therapies, “Complementary and alternative medicine—practice, attitudes, and knowledge among healthcare professionals in New Zealand: an integrative review”. Substantial errors in their citation of the recent research and methodology by McDowell, Kohut & Betts (2019) pertaining to the practice of acupuncture in New Zealand by physiotherapists are presented. The actual results of McDowell et al.’s work and the true state of acupuncture use by their sample group is reported.

More accurately McDowell et al. [2] reported that 60 physiotherapists (48.4% of the 124 total respondents) practise acupuncture during pregnancy.This represented 0.8% of the 7337 registered physiotherapists in NZ.Liu et al. 's citation would infer that 48.4% of all registered physiotherapists in NZ (3551/7337) practice acupuncture for pregnant women; a 60-fold overestimation.McDowell et al. very clearly reported the limitations of their study; "The results of this purposive study may not be indicative of the opinion of all NZ physiotherapy acupuncturists and dry needlers" page 37 [2] , and Liu et al. 's interpretative flaws may lead to future publication errors if it is cited further.

Extrapolation error-Post graduate training
The following statement in

Methodology citation error
In their paper Liu et al. also state: "Instruments used in the eight surveys varied, without psychometric properties reported; four studies used instruments that were developed and adapted from previous studies".page 4 [1].
McDowell et al. 's paper clearly describes the development of the electronic survey questionnaire, expert peer review, and piloting prior to the main survey.It was not adapted from a previous study as cited by Liu et al. above.

The current state of acupuncture practice in NZ by physiotherapists
The practice of acupuncture is not currently regulated for physiotherapists in NZ, being considered "a modality within the practice of physiotherapy" [3].Registered physiotherapists may practice within a defined field of practice as autonomous practitioners but must "complete or be currently undertaking, relevant, sufficient, and appropriate education and training and continuing professional development to maintain such knowledge and competence" [4].NZ registered physiotherapists who have gained post graduate qualifications in acupuncture or have trained in dry needing are termed "physiotherapy acupuncturists" to identify as a separate profession to acupuncturists.
At the time of the survey 7337 physiotherapists were registered to practice in NZ [5].Sixty nine percent of those were members of their national society, Physiotherapy New Zealand (PNZ) [6], and only 310 were members of PNZ's special interest group the Physiotherapy Acupuncture Association of New Zealand (PAANZ).Further demographic information on the total number of NZ physiotherapists who have undertaken relevant education or who are currently practicing needling was not available.
Acupuncture has been taught and practiced by physiotherapists in NZ since 1992 [7][8][9].However, the total number of physiotherapists utilising this complementary and alternative medicine in NZ is unknown.This has been a limiting factor for several research surveys to date [10,11].The paper "Safe acupuncture and dry needling during pregnancy: New Zealand physiotherapists' opinion and practice", was published in 2019 in Integrative Medicine Research [2].It is important to emphasise that the paper's results did not have access to the entire population of potential respondents.The Privacy Act of New Zealand [12] prohibits the direct use of Physiotherapy Board of New Zealand (PBNZ) membership lists to target the entire survey population.McDowell et al. 's survey recruitment was via invitation only by PNZ e-mail, with additional links available through PAANZ and PNZ webpages, closed acupuncture group Facebook pages and physiotherapy newsletters within NZ.
Whilst McDowell et al. 's primary aim was to gather basic demographics and examine the opinions, practice and level of understanding held by NZ physiotherapy acupuncturists providing acupuncture and dry needling for pregnant women, their results were never intended to be reflective of the entire population of physiotherapists in New Zealand.
Regrettably, this fact seems to have been lost by Liu et al. when extrapolating McDowell et al. 's data as verbatim statistics for the entire NZ physiotherapy population.
Survey response rates have been on the decline for the past decade in the field of health related research [13,14], with response rates consistently lower than those of surveys of the general population [15].Field et al. [16] reported response rates of between 13 and 39% are common in healthcare research.Cunningham et al. [13] found an overall response rate of 35% amongst physicians in Canada on a sensitive topic (medical billing practices) which was comparable to 39.6% response rate reported in the meta-analysis by Cook [17].The McDowell et al. 's survey noted the existence of a low response rate (particularly from physiotherapy acupuncturists with only dry needling training), and a high number of missing responses within individual responses.This sample may not represent any definable population larger than NZ physiotherapy acupuncturists, a concept that appears to have been neglected by Liu et al. 's integrative review [1].

Further research
Research-based practice is central to improving the quality of health care by obtaining information about the knowledge, attitudes, practice patterns, the needs of practitioners [18] and to evaluate the impact of clinical research on practice [13].Soliciting practitioner input is also essential when existing healthcare policies are being updated or to inform new policies [19].
Liu  [20][21][22][23], fortunately without specifically referring to the erroneous sections.We ask that Lui et al. 's statements be corrected via publication of this correspondence, that is indexed and bidirectionally linked to the original article to prevent further and future errors.
• fast, convenient online submission • thorough peer review by experienced researchers in your field • rapid publication on acceptance • support for research data, including large and complex data types • gold Open Access which fosters wider collaboration and increased citations maximum visibility for your research: over 100M website views per year

•
At BMC, research is always in progress.

Learn more biomedcentral.com/submissions
Ready to submit your research Ready to submit your research ?Choose BMC and benefit from: ? Choose BMC and benefit from: et al. have failed to recognize the limitations of McDowell et al. 's research sample, thus committing a statistical error of extrapolating a small survey finding to the entire NZ physiotherapy population.This raises concern that others may read their paper and cite it further (especially with the error prominent in the abstract), compounding errors in perceived practice if they are compared to the inflated NZ data.To date four papers have cited Liu et al. 's paper Liu et al. 's paper is inaccurate and misleading.